Unreliable Yet Still Replicable: A Comment on LeBel and Paunonen (2011)

نویسندگان

  • Maarten De Schryver
  • Sean Hughes
  • Yves Rosseel
  • Jan De Houwer
چکیده

Lebel and Paunonen (2011) highlight that despite their importance and popularity in both theoretical and applied research, many implicit measures continue to be plagued by a persistent and troublesome issue-low reliability. In their paper, they offer a conceptual analysis of the relationship between reliability, power and replicability, and then provide a series of recommendations for researchers interested in using implicit measures in an experimental setting. At the core of their account is the idea that reliability can be equated with statistical power, such that "lower levels of reliability are associated with decreasing probabilities of detecting a statistically significant effect, given one exists in the population" (p. 573). They also take the additional step of equating reliability and replicability. In our commentary, we draw attention to the fact that there is no direct, fixed or one-to-one relation between reliability and power or replicability. More specifically, we argue that when adopting an experimental (rather than a correlational) approach, researchers strive to minimize inter-individual variation, which has a direct impact on sample based reliability estimates. We evaluate the strengths and weaknesses of the LeBel and Paunonen's recommendations and refine them where appropriate.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

High Stakes Require More Than Just Talk: What to Do About Corruption in Health Systems; Comment on “We Need to Talk About Corruption in Health Systems”

Reluctance to talk about corruption is an important barrier to action. Yet the stakes of not addressing corruption in the health sector are higher than ever. Corruption includes wrongdoing by individuals, but it is also a problem of weak institutions captured by political interests, and underfunded, unreliable administrative systems and healthcare delivery models. We ur...

متن کامل

Still the Great Debate – “Fair Balance” in Direct-to-Consumer Prescription Drug Advertising; Comment on “Trouble Spots in Online Direct-to-Consumer Prescription Drug Promotion: A Content Analysis of FDA Warning Letters”

The above titled paper examined the Food and Drug Administration’s (FDA’s) warning letters and notice of violations (NOV) over a 10-year period. Findings from this content analysis reinforced what has been the primary issue for prescription direct-to-consumer advertising (DTCA) since its beginning, the fair balance of risk and benefit information. As opposed to another analysis in 2026 about th...

متن کامل

Mitigating Evidentiary Bias in Planning and Policy-Making; Comment on “Reflective Practice: How the World Bank Explored Its Own Biases?”

The field of cognitive psychology has increasingly provided scientific insights to explore how humans are subject to unconscious sources of evidentiary bias, leading to errors that can affect judgement and decision-making. Increasingly these insights are being applied outside the realm of individual decision-making to the collective arena of policy-making as well. A recent editorial in this jou...

متن کامل

Priority Setting: Right Answer to a Far Too Narrow Question?; Comment on “Global Developments in Priority Setting in Health”

In their recent editorial, Baltussen and colleagues provide a concise summary of the prevailing discourse on priority-setting in health policy. Their perspective is entirely consistent with current practice, yet they unintentionally demonstrate the narrowness and moral precariousness of that discourse and practice. I respond with demonstrations of the importance of ‘interrogating scarcity’ in a...

متن کامل

Breaking Gridlock in Health Policy?; Comment on “A New Synthesis”

Pierre-Gerlier Forest has put forward the case that we are on the brink of a revolution in health policy that will be the result of the interplay of five factors. I would not challenge any of them but would emphasize the need to address socio-economic health inequalities, which have the potential to become a major cost driver in a time of growing economic inequality. To Dr. Forest’s list, I wou...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره 6  شماره 

صفحات  -

تاریخ انتشار 2015